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ABSTRACT 

Aims. The clustering properties of a large sample of (/-dropouts are investigated and compared to very precise results for 6-dropouts from 
other studies to identify a possible evolution from z = 4 to z = 3. 

Methods. A population of ~ 8800 candidates for star-forming galaxies at z = 3 is selected via the well-known Lyman-break technique from 
a large optical multicolour survey (the ESO Deep Public Survey). The selection efficiency, contamination rate, and redshift distribution of 
this population are investigated by means of extensive simulations. Photometric redshifts are estimated for every Lyman-break galaxy (LBG) 
candidate from its UBVRI photometry yielding an empirical redshift distribution. The measured angular correlation function is deprojected 
and the resulting spatial correlation lengths and slopes of the correlation function of different subsamples are compared to previous studies. 
Results. By fitting a simple power law to the correlation function we do not see an evolution in the correlation length and the slope from 
other studies at z = 4 to our study at z = 3. In particular, the dependence of the slope on UV-luminosity similar to that recently detected for a 
sample of 6-dropouts is confirmed also for our (/-dropouts. For the first time number statistics for (/-dropouts are sufficient to clearly detect a 
departure from a pure power law on small scales down to ~ 2" reported by other groups for 6-dropouts. 
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1. Introduction 

For more than a decade now, the high-redshift universe has 
become reachable by observations mainly due to the devel- 
opment of efficient c olour selection technique s . The group 



around C. C. Steidel dSteidel & Hamilton 1993; Steidel et al 



1996, 1999) has introduced the Lyman-break technique se- 
lecting high-redshift, star-forming galaxies from optical mul- 
ticolour data by their pronounced Lyman-break. Many groups 
have used this technique and analysed various properties of 
these galaxy populations from redshifts z ~ 3 up to z ~ 7. 

A particular emphasis in these studies was given to the clus- 
tering proper t ies of the Lyman-break galaxy (LBG) samples 
dSteidel et al l Il998k iGiavalisco et al l Il998t lAdelberger et al l 
19981 120051. IGiavalisco & DickinsonlboOll: buchi et al.ll200li 
2004, l2005l;|Porciani & Giayaliscol2002|:lBouche & Lowenthal 



2004; iFoucaud et all 120031: lAllen et al.ll2005l; |Lee etal.l l2006; 
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Kashikawa et al. 2006; iGawiser et al.1 2006). Going back in 
cosmic time the correlation strength of these high-z galax- 
ies can be directly compared to A^-body simulations or semi- 
analytical predictions yielding estimates of, e.g., the galaxy 
bias for early epochs. These results can then be used as an in- 
put for models of galaxy formation, and help to constrain the 
large number of free parameters to adjust. The more precise 
our knowledge of the clustering evolution becomes the more 
accurate our understanding of galaxy evolution will be. 

In this context it is of crucial importance to reach a similar 
precision for the same galaxy populations at different redshifts. 
While in the beginning most LBG studies concentrated on rel- 
atively bright z — 3 (/-dropouts, in the last years more and 
more groups have focused on the investigation of LBGs at red- 
shifts around z = 4 selected as B-dropouts. This is obviously 
due to the fact that deep and wide (/-band images are still a 
very telescope-time consuming task and some recent wide-field 
cameras like Suprimecam or space-based surveys like GOODS 
even lack a (/-filter entirely. 

By estimating the angular correlation function of nearly 
17 000 g-dr opouts selected fro m the Subaru/XMM-Newton 
Deep Field, lOuchi et al.l (12005b find evidence for a departure 
from a pure power law on small scales. The same trend is re- 
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ported bv lLee et al, l d2006h for B- and V-dropouts from the very 
deep GOODS ACS data. Neither the number statistics in the 
former study mentioned nor the depth and angular resolution 
of the GOODS data have a comparable counterpart at slightly 
lower redshifts. The most pr ecise estimates o f [/-dr opout clus- 
tering to date come from lAdelberger et al.1 ( 12005b estimating 
the angular correlation function but not reporting any obvious 
excess on small scales. The question whether this is an evolu- 
tionary effect or whether this feature is only visible in the z — 4 
data because of their superior quality can only be answered by a 
[/-dropout survey comparable in size to the B-dropout surveys 
mentioned above. 

In this paper we describe our investigations of z = 3 LBGs 
in the ESO Deep Public Survey (DPS). The methods presented 
here are based on our investigations in the C handra Deep Field 



South (the DPS field Deep2c) presented in Hildebra ndt et al 



d2005l) . In Sect. |2] the data of the DPS and the selection of 
the LBGs are described. Simulations to assess the performance 
of our LBG selection are presented in Sect. [3] The clustering 
analysis is covered in Sect. [4] A summary and conclusions are 
given in Sect. [5] 

Throughout this paper we adopt a standard ACDM cosmol- 
ogy with [H ,Clm,QA,cr$] = [7010ns- 1 Mpc" 1 , 0.3,0.7,0.9]. 
We use Vega magnitudes if not stated otherwise. 



2. The data and the samples 

2.1. DPS images 

The ESO Deep Public Survey is a deep multicolour sur- 
vey carried out with the Wide Field Imager (WFI), an eight- 
chip CCD camera of 34' x 33' field-of-view mounted at the 
MPG/ES02.2m telescope at La Silla. The ima ges used for 
this study are described in lHildebrandt et alj (12006b along with 
the characteristics of the WFI filter-set. Furthermore, details 
on the raw data, th e data reduction with our THELI pipeline 
( Erb en et al.l 12005). the astrometric and photometric calibra- 
tion, the quality control, and the data release to the scientific 
community can be found there. 

For our studies on LBGs we use seven fields (2 sq. deg) with 
complete coverage in the UBVRI-filters, in particular the fields 
Deepla, lb, 2b, 2c, 3a, 3b, and 3c, respectively. Their proper- 
ties are summarised in Table Q] 

Note that the images of the field Deep2c used in the current 



study are different from the images used in Hild ebrandt et al 



(2005). More data have become available so that the current 
images in this field are considerably deeper. 

2.2. Catalogue extraction 

First, the different colour images of one field are trimmed to 
the same si ze. The seeing is measu red for these images and 
SExtractor dBertin & Arnoutsl U996I) is used to create RMS 
maps. From these RMS images the local limiting magnitude 
(lcr sky background in a circular aperture of 2xFWHM diam- 
eter) in each pixel is calculated and limiting magnitude maps 
are created. Then every image is convolved with an appropri- 



ate Gaussian filter to match the seeing of the image with the 
worst seeing value. 

For the catalogue extraction SExtractor is run in dual-image 
mode with the unconvolved /?-band image for source detection 
and the convolved images in the five bands for photometric flux 
measurements. In this way it is assured that the same part of a 
galaxy is measured in every band. In the absence of a strong 
spatial colour gradient in an object this method should lead to 
unbiased colours especially for high-redshift objects of small 
apparent size. In the following, we use isophotal magnitudes 
when estimating colours or photometric redshifts of objects. 
The total R-bmd magnitudes always refer to the SExtractor 
parameter MAG_AUTO measured on the unconvolved /?-band 
image. 



2.3. Photometric redshift estimation 

Photometric redshifts are estimated for all objects in the cata- 
logue from their U BVRI photometry usi ng the publicly avail- 
able code Hyperz dBolzonella et alJuOOOl) . The technique ap- 



plied i s essentially the same as described in Hild ebrandt et al 
(2005) with the only difference that in the current study 



we use isophotal magnitudes extracted from images with 
matched seeing instead of seeing adapted aperture magni- 
tudes. In Hildebrandt et al. (2006, in preparation) we compare 
our photometric redshift estimates to several hundred spectro- 
scopic redshifts from the VIMOS VLT Deep Survey (VVDS; 
Le Fevre et al . 2004) in the field Deep2c and find that the com- 
bination of isopho tal magnitudes with the t emplates created 
from the library of lBruzual & Chariot! d 19931) yields the small- 
est scatter and outlier rates at least for the redshifts probed by 
the VVDS (z < 14). For R < 24 we find a standard deviation 
of cr = 0.052 for the quantity Az = (z sp ec - Zphot) / (l + z sp ec) 
after rejecting 5% of outliers (objects with Az > 0. 15). With in- 
creasing redshift and decreasing angular size of the objects the 
isophotal magnitudes on images with matched seeing should 
approach the seeing adapted aperture magnitudes. Investigating 
the redshift distributions of our U -dropout sample (see below) 
we see no significant difference between the two approaches 
so that the results of the clustering measurements are not influ- 
enced by this choice. 



2.4. Sample selection 



In Hildebrandt et al. I d2005l) we chose quite conservative crite- 
ria for our [/-dropout selection. In particular, we tried to define 
colour cuts in such a way to avoid regions in colour space with a 
considerable amount of contamination. Supported by our sim- 
ulations (see Sect. and after refining our photometric mea- 
surements (see above), which should yield better colours, es- 
pecially for the possible contaminants, we decided to relax our 
selection criteria. The performance of our selection in terms of 
contamination and efficiency is analysed in Sect. [3] by means 
of simulated colour catalogues. In Fig.Q]the colour-colour dia- 
gram for one field is shown with the old and the new selection 
criteria represented by the boxes. We select candidates for z = 3 
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Table 1. The DPS fields with five colour coverage. The limiting magnitudes in columns four to eight are measured in a circular 
aperture of 2xFWHM diameter from the Icr sky background fluctuations of the images before convolution with a Gaussian filter 
(see text). In column nine the seeing FWHM values after convolution are given. Column ten contains the number of objects 
satisfying Eq. ([TJ. In the fields Deep2b and Deep3a less {/-dropouts are selected due to inferior quality of the imaging data (see 
text). The completeness limits for LBG selection in column eleven are estimated from Fig. [2] These visual estimates are very 
rough with an accuracy of ~ 0.5 mag. The effective area used for LBG selection is given in the last column. 



field 
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Dec [d m s] 
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■a mag 
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LBG compl. limit 


eff. area 




J2000.0 


J2000.0 
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R 
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[arcmin"] 
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22:55:00.0 
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27.8 


27.5 
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26.3 


r?3 


1420 


25.0 


1045 
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22:52:07.1 


-40:13:00 


27.0 
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27.1 


27.2 


26.2 


1'.'3 


1114 


24.5 
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Deep2b 


03:34:58.2 


-27:48:46 
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28.0 
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26.9 
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K'3 
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24.0 
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25.8 
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11:22:27.9 


-21:42:00 


26.9 


27.9 


27.3 


27.3 


26.2 


l'.'O 
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25.0 


1072 
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11:20:05.9 
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25.0 
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Fig. 1. (U - V) vs. (V - R) colour-colour diagram of galax- 
ies in the field Deep2c. T he upper box repr e sents the old se- 
lection criteria adopted in iHildebrandt et al. ( 2005 ) while the 
lower extension represents the selection criteria of the current 
study. The (U - V) colours of objects that are satisfying the 
LBG selection criterea but are not detected in the [/-band are 
lower limits (arrows). In contrast the detected objects satisfy- 
ing the selection criterea are plotted as filled circles. 



LBGs in the following way: 

0.3 < (U-V) , 
-0.5 < (V-R) < 1.5 , 
3(V-R) < (U-V) + 0.2, 



(1) 



Furthermore, we require every candidate to be detected in 
V and R and to be located in a region on our images where 
the local limiting magnitudes in UVR are not considerably de- 



creased. This is necessary to avoid complex selection effects in 
colour space due to varying depths over a single field. In our 
catalogues we find 8826 objects satisfying these selection cri- 
teria. 

Every candidate is inspected visually in all five fil- 
ters. Moreover, the redshift-probability distribution (see 



Hildebrandt et al. 2005), the location in the field, and the lo- 



cation in the colour-colour diagram is checked for every ob- 
ject. Approximately one third of the candidates is rejected in 
this way. Most of these rejected objects are influenced by the 
straylight from bright neighbouring objects (indicated by their 
extraction flags or visible in the 10" x 10" thumbnail im- 
ages) so that their colours cannot be trusted. Merely 72 objects 
(< 1%) are rejected due to their redshift-probability distribu- 
tion in combination with a suspicious location in the colour- 
colour diagram near the stellar locus. Thus, the photometric 
redshift distribution is almost not affected by the exclusion of 
these objects. 

The magnitude dependent angular number-densities of the 
accepted candidates for the seven fields and for the whole DPS 
are displayed in Fi g. [2] in comparison to the values found by 



Steidelet al.l (fl999). For R < 24 all seven fields show approxi- 



mately the same LBG source density within a reasonable field- 
to-field variance. The field Deep2b can be regarded as fairly 
complete down to R = 24.5 and the fields Deepla, 3b, and 3c, 
respectively, down to R = 25. But only the field Deep 2c shows 
the same density as the survey bv lSteidel et al] (fl999) down to 
R - 25.5. The underdensity of Deeplb and Deep2b can be ex- 
plained by the inferior seeing in the detection images (R) while 
the underdensity of Deep3a is due to a shallower [/-band im- 
age. 

As long as one restricts investigations in a given magnitude 
bin to fields that can be regarded as uniform in terms of LBG 
selection, these investigations are not subject to systematic ef- 
fects due to varying selection efficiency between the fields. This 
is in particular important in the clustering analysis to avoid ar- 
tificial correlations originating from non-uniform depths. 

The photometric redshift distribution of all accepted objects 
is shown in Fig. [3] The mean redshift of (z) = 2.96 (4-cr out- 
liers are rejected) is essentially the same as the spectroscopic 
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Fig. 2. Source coun ts of LBGs as a function of /?-band magnitude. The DPS densities are represented by crosses while the 
Steidel et al.1 (11999) densities are represented by triangles which are offset by +0. 1 mag just for clarity. 



mean found bv lAdelberger et alj (12005b for their LBG sample, 
but our distribution seems to be slightly narrower (<x = 0.24). 
However, without spectroscopic information we are not able 
to judge whether this is due to the different selection method 
with a different camera and filter set or due to imperfect pho- 
tometric redshift estimation. In the following we will use the 
distribution inferred from our photometric redshifts indicating 
whenever the width has a large influence on our results. 

3. Simulations of objects' colours in the DPS 

Without a large spectroscopic survey of our LBGs at hand the 
only possible way to estimate properties of our LBG samples 
like, e.g., the contamination rate is to create a simulated colour 
catalogue. 

3.1. The role of stars in our sample 

The TRILEGAL galactic model by lGirardi etaD d2005h is used 



to simulate the number of stars in all seven fields and their 
colours in the WFI filter set. In this way we obtain accurate 
U - V and V - R colours and are able to quantify the amount 
of stellar contamination in the LBG selection box. In Fig. [4] 
the colours of stars in the field Deep la are shown, represen- 
tative for the whole survey. The selection criteria were chosen 
in such a way that stellar contamination is very low, which is 
confirmed by Fig. |4](see also the bottom panel of Fig. [TOl . 

3.2. Colours of galaxies 

The code Hyperz cannot only be used to estimate photomet- 
ric redshifts but also to create colour catalogues of galaxies 
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Fig. 3. Photometric redshift distribution of all accepted LBG 
candidates. The distribution has a mean of (z) = 2.96 and an 
RMS ofcr = 0.24. 



at different redshifts and of different spectral types. We simu- 
late huge random mock catalogues in magnitude bins of width 
0.5 mag of 500 000 galaxies each, evenly distributed over the 
redshift interv al < z < 7 and over a ll spectral types from 



the library of iBruzual & Chari ot ( 1993) provided by Hyperz. 
Magnitude errors are simulated by Hyperz according to the l-cr 



H. Hildebrandt et al.: Lyman-break galaxies in the DPS 



5 



-1 



- 

— 


1 


77 


- 


- 




/ 7 


" - 










- 


1 




- 











1 



1 
V-R 



Fig. 4. (U — V) vs. (V - R) colour-colour diagram of simulated 
stars in the field Deep la. The boxes are the same as in Fig.Q] 



limits in the five bands. This is done separately for every field 
taking into account the different dep ths in the five b ands. From 
the photometric redshift code BPZ dBenftez 2000) we extract 
magnitude- and spectral type-dependent redshift distributions 
derived from the Hubble Deep Field. We as sign the two reddest 
Hyper z spectral types from the library of iBruzual & Chariot 
d 19931) ("Burst" and "E") to the BPZ z-distribution for ellip- 
tical galaxies, two intermediate types ("Sb" and "Sc") to the 
z-distribution for spirals, and the two bluest spectral types 
("Sd" and "Im") to the z-distribution for star-forming galax- 
ies. Galaxies are taken from the evenly distributed catalogues 
with numbers and spectral types according to these redshift dis- 
tributions to create realistic catalogues for 0.5 mag intervals. 
Finally, from these catalogues the galaxies are taken with num- 
bers scaled to the /-band number-counts in the seven fields. In 
this way, for every field a catalogue is created which gives a fair 
representation of our data in 0.5 mag wide intervals. The U — V 
vs. V — R colour-colour diagram of the simulated galaxies is 
shown in Fig. [5] 

Certainly, it is a strong assumption that the chosen template 
set represents the galaxy population in our data at all redshifts. 
Furthermore, the redshift distributions were extracted from the 
Hubble Deep Field which is subject to cosmic variance. These 
shortcomings are most probably responsible for the slight dif- 
ferences between Fig. Q] and Fig. [5] and the simulations should 
only be regarded as rough estimates. 

Applying the colour cuts from Eq. (Q]i to the simulated star- 
and galaxy-catalogues we obtain estimates for the contamina- 
tion rate in our LBG sample at different magnitudes which are 
plotted in the bottom panel of Fig.fTOland included in Table[2] 
For the considered magnitude range of 22.5 < R < 26 the total 
contamination is below 20%. 
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Fig. 5. (U — V) vs. (V - R) colour-colour diagram of simulated 
galaxies. The boxes are the same as in Fig. Q] Objects with a 
redshift of z > 2.5 are plotted as crosses. We find good agree- 
ment in the overall shape of the colour distribution of the sim- 
ulated galaxies to the real data (see Fig. [TJ. The slight differ- 
ences, however, may be attributed to an imperfect template set 
and to a redshift distribution which is subject to cosmic vari- 
ance. 



We define the completeness in a particular magnitude- and 
redshift-bin as the ratio of the number of objects selected by 
our criteria to the number of objects in the whole catalogue. 
Since the objects in our mock catalogue are generated in such 
a way that their magnitude errors are derived from the typi- 
cal limiting magnitudes in the DPS, with these simulations the 
completeness of our selection can only be quantified with re- 
spect to this catalogue. In Fig. [6] the completeness in depen- 
dence of /?-band magnitude and redshift is shown. The values 
should be regarded as an upper bound for the total complete- 
ness with respect to the whole galaxy population since some 
of them may be entirely undetectable in our images due to 
low surface brightness. Certainly, this becomes more serious 
for R > 25 where our LBG number-counts start to drop (see 
Fig.0. 

The redshift distribution of the selected simulated galaxies 
in the magnitude interval 23 < R < 25 is shown in Fig. [7] 
with good agreement to the photometric redshift distribution in 
Fig. [3] 



4. Clustering properties 

4.1. Method 

The angular cor r elatio n function is estimated as described in 
lLandv&SzalavId 1993b . 
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Fig. 6. Completeness as defined in the text of our LBG selec- 
tion in dependence of magnitude and redshift averaged over the 
seven fields. 



u>(6) = 



DD - 2DR + RR 



RR 



(2) 



The numbers of galaxy pairs with a separation between 6 and 
6 + 66 in the data (DD), in a random catalogue with the same 
field geometry and density (RR), and between the data and 
the random catalogue (DR) are counted on the DPS fields 
with comparable selection efficiency for a particular magnitude 
range separately. The angular correlation function for the whole 
survey is then estimated from the sums of the three quantities 
over the fields. We appl y Poissonian erro rs for the angular cor- 
relation function dLandv & Szala vlll993l) . 



6oj(0) 



1 + (o(6) 



DD 



(3) 



Although the area of the DPS is rather large in comparison 
to previous {/-dropout surveys the results may nevertheless be 
subject to cosmic variance. We estimate the amplitude of the 
cosmic variance from the field-to-field variance which includes 
cosmic variance as well as shot-noise from the limited number 
of galaxies used for the estimate of u>(&). We find values which 
are comparable in size to the Poissonian errors. This means that 
the errors are dominated by shot-noise while cosmic variance 
is negligible. Thus, the application of Poissonian errors is jus- 
tified. 

In Fig. [8] the angular correlation function is shown for all 
[/-dropouts with 22.5 < R < 23.5 of all seven fields as well as 
with 22.5 < R < 26 of the fields Deepla, Deep2c, Deep3b, and 
Deep3c. 

A power law, 



Fig. 7. Redshift distribution of 23 < R < 25 (to avoid magni- 
tude regions with higher contamination) galaxies selected from 
the mock catalogues of Deepla, 2c, 3b, and 3c by Eq. dTJ show- 
ing good agreement to Fig. [3] with only a slightly wider peak. 
The distribution of galaxies with 2 < z < 4 has a mean of 
(z) = 2.89 and a standard deviation of <x = 0.30. 




o.oi 



0[arcmin] 



u(6) = A a 6- 



(4) 



Fig. 8. Angular correlation function for [/-dropouts with 
22.5 < R < 23.5 (crosses) of all seven fields and with 22.5 < 
R < 26 (open squares, slightly offset for clarity) of the fields 
Deepla, Deep2c, Deep3b, and Deep3c. The solid lines repre- 
sent power law fits to the data in the range 0.1' < 6 < 10'. The 
angular correlation function of the faint sample shows an ex- 
cess on small scales with respect to the power law fitted to the 
data on intermediate scales. 
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is fitted to th e angular correlation fu nction and the Limber 
equation (see Hilde brandt et al. 2005) is used to estimate the 
real-space correlation function, £0 In this step we apply our 
photometric redshift distribution presented in Sect. 12.41 We 
parametrise the power law approximation of the real-space cor- 
relation function in the following form: 



f(0 = 



(5) 



with r being the comoving distance, ro being the comoving cor- 
relation length, and y — 1 + 6. 

The estimator from Eq. (|2]l is known to be biased low be- 
cause the galaxy density in the field is estimated from the data 
itself and no fluctuations on the scale of the field size are ac- 
counted for, 



W rea l(0) = CO(0) + IC , 

with the bias IC usually called "t he integral constraint". 



(6) 



It can be shown (see e.g. Adelberg er et alj |2005) that 



the expectation value of this bias equals the variance of 
galaxy-density fluctuations on the size of the field-of-view. 
W e estimate the in t egral constraint by the method outlined 



Adel berger et alj (12005b from the linear cold dark matter 



in 

(CDM) power spectrum. The variance of mass cr^ DM in our 
typical survey volumes can be estimated from integrating the 
power spectrum over the Fourier transform of such a survey 
volume. The survey volume of z — 3 LBGs in a single DPS 
field can be reasonably approximated by a square on the sky 
(comoving dimensions of 42 x 42(/z _1 Mpc) 2 at redshift z — 3) 
and a Gaussian in radial direction (cr = 88/j~'Mpc) resulting 
in ^cdm= 0.0017. 

Assuming a linear relationship between the fluctuations of 
the mass density and the galaxy density, the linear bias factor 
can be estimated from the correlation function. An iterative ap- 
proach to estimate the IC first and then the bias factor from the 
fitted real-space correlation function conver ges quickly. For a 



detailed description of the method we refer to Adelber ger et al 
(2005). 



4.2. Results 

In Table |2] the results for various subsamples of the LBGs are 
presented in comparison to results from previous studies. The 
errors on the correlation lengths are derived from Monte-Carlo 
simulations taking into account the fitting errors for A w and 
5 and assuming that these are Gaussian and uncorrelated. In 
Fig. |9]the confidence regions for A w and 6 for the 22.5 < R < 26 
subsample are plotted as 2-dimensional contours. 

We investigate the influence of the binning by estimating 
the correlation length for 10 to 25 bins and find that the stan- 
dard deviation over these 16 binnings is comparable or smaller 
than the error introduced by the fitting. We choose a common 



1 Note that the Limber equation is inaccurate to some degree due to 
the relative l y nar row distribution in comoving distance of our LBGs. 
See lSimod (2006) for details. This is certainly also the case for other 
LBG studies applying the Limber equation so that the relative com- 
parisons presented here are not affected seriously. 
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Fig. 9. Joint 68.3%-, 95.4%-, and 99. 8% -confidence regions 
(corresponding to Ax 2 = [2.3; 6.2; 1 1.8]) for the power law pa- 
rameters A w and 6 (see Eq. (0]l) in the fit to the angular correla- 
tion function of the 22.5 < R < 26 subsample. 

binning for all magnitude intervals which samples the correla- 
tion function well. 

There are, however, systematic uncertainties in our corre- 
lation analysis, the most serious being our selection function. 
We must rely on the validity of our photometric redshift dis- 
tribution shown in Fig. [3] The derived correlation lengths cer- 
tainly depend on the width of this distribution, with wider dis- 
tributions resulting in larger correlation lengths. Moreover, the 
results from the simulations in Sect. [3] may be subject to cos- 
mic variance since the underlying redshift distributions were 
derived from the small HDF Thus, our contamination and com- 
pleteness estimates must be regarded as approximate values. 

Furthermore, we cannot correct our clustering measure- 
ments for contamination directly as there are no spectroscopic 
observations of our WFI-selected LBG samples available yet. 
In general, a contamination rate / of uncorrelated sources in 
our catalogues will lead to an angular correlation function with 
a measured amplitude A = (1 - f) 2 A rea i implying a corrected 
correlation length ro iC orr = (1 — Z) -2 ' 7 ^- However, as we do 
not know from our simulations about the exact clustering be- 
haviour of the contaminants we do not apply such a correction. 

We see clustering segregation with rest-frame UV luminos- 
ity in our data. In Fig. \W\ the dependence of the correlation 
lengths and the slope of the correlation function are plotted 
against limiting magnitude along with the contamination es- 
timates from Sect. 13.21 The correlation lengths for the different 
subsamples decrease monotonically with limiting magnitude 
down to Rn m = 25 and then stay constant whereas the slope 
decreases down to R\i m = 24.5. 

The observation that more luminous LBGs show larger cor- 
relation lengths was reported quite some time ago (see e.g. 
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Table 2. Clustering measurem ents of LBGs in th e DPS fields for diff erent limiting magnitude s and results from other surveys for 
comparison. O2005 refers to Ouc hi et al. (2005) and A2005 refers to lAdelberger et al" (2005). The power law fits to the angular 
correlation function are performed in the range O'.l < 9 < 10'. The errors on the correlation lengths are estimated from the 
fitting errors of the slope and the amplitude of the angular correlation function. No possible systematical uncertainties introduced 
by the photometric redshift distribution, the binning, etc. are included. Notice that the 22.5 < R < 25.5, 22.5 < R < 26, and 
23.3 < R < 25.3 samples suffer from some incompleteness at the faint end which may be the reason for non-evolution from 
magii m = 25 to magij m = 26 and slight disagreement to the results by [Adelberger et alj (12005b . In the second column the number 
of fields are listed with "7" corresponding to all seven DPS fields with UBVRI coverage, "5" corresponding to the fields Deepla, 
lb, 2c, 3b, and 3c, and "4" corresponding to Deepla, 2c, 3b, and 3c, respectively. The values for the integral constraint, IC, and 
the linear bias factor, b, in the sixth and seventh column are estimated as described in Sect. 14. II and the contamination fractions, 
/, in column eight are derived from the simulations presented in Sect. [3] The average number of LBGs per halo, (Ng^ , and the 
average mas s of an LBG hostin g halo, (Mhaio) are estimated as detailed in Sect. 14.31 Note that the i' AB , limiting magnitudes in 
the study bv lOuchi et alj d2005l) can be related to our Ry egd limiting magnitudes by i' AB lim =^vega,iim + 1 as described in the text. 



Sample 


No. fields 


N 


y 


[A" 1 


ro 

Mpc] 


IC 


b 


/ 
[%] 


<".) 


log <M halo > 
[h- l M Q ] 


22.5 < R < 23.5 


7 


228 


2.26 ± 0.20 


7.2 


± 1.2 


0.045 


5.1 


18.4 


0.46 ± 0.73 


1 9 7Q+0.05 
^ -0.05 


22.5 < R < 24.0 


7 


965 


1.92 ±0.09 


6.3 


±0.6 


0.015 


3.0 


11.1 


0.43 ± 0.37 


12 46 +0 - 03 


22.5 < R < 24.5 


5 


1864 


1.55 ±0.08 


5.2 


±0.4 


0.015 


3.0 


9.3 


0.42 ± 0.24 


1 9 9Q+0.09 


22.5 < R < 25.0 


4 


2950 


1.57 ±0.06 


4.8 


±0.3 


0.013 


2.8 


12.0 


0.61 ±0.51 


12 12 +ai0 


22.5 < R < 25.5 


4 


3913 


1.58 ±0.05 


4.8 


±0.3 


0.014 


2.9 


15.6 


0.44 ± 0.23 


12 15+ 015 


22.5 < R < 26.0 


4 


4363 


1.54 ±0.04 


4.8 


±0.2 


0.014 


2.9 


19.4 


0.50 ± 0.24 


12 15 +014 

-0.20 



O2005 (^ =4 <24.5) 
O2005 (;'; B , =4 < 25.0) 
O2005 (/; B ~ =4 < 25.5) 
O2005 (i' AB ~,_ 4 < 26.0) 
O2005 (i' AB " =4 < 26.5) 
O2005 (i' AB , =4 < 27.0) 




239 
808 
2231 
4891 
8639 
12 921 


2.1 ±0.4 
1.9 ±0.3 
1.8 ±0.1 
1.8 ±0.1 
1.6 ±0.1 
1.6 ±0.1 


4 Q+4.3 

5 5 +L7 
5 +S7 
5 +0 - 4 

J '"-0.4 

4 8 +0 - 2 

-0.3 

4 4+0.1 

^•^-0.2 




2 +u - 2 

"•^-0.2 

3 +0 - 4 

"•-'-0.3 

6 +ai 

"•"-0.5 

6 +al 
"•"-o.i 

6 +ai 
"•"-o.i 

6 +al 

"■"-0.2 


12 3 +al 
12 3 +01 

12 r 01 

12 +0 1 

—0.1 

1 i q+0.05 

11 ' 7 -0.05 
1 i O+0.07 
li -8-0.04 


23.3 < 7? < 25.3 


4 


3541 


1.60 ±0.03 


5.0 ±0.2 


0.015 3.0 18.7 






A2005 (23.5 < R AB < 25.5) 






1.57 ±0.14 


4.0 ±0.6 


~ 0.01 







Giavalisco & DickinsonlboOlHOuchi et alj|200lb . In the CDM 
framework more massive halos are more strongly biased than 
less massive halos with respect to the whole mass distribution. 
Thus, brighter LBGs are supposed to be hosted by more mas- 
sive halos than fainter ones. For a quantitative analysis of halo 
properties see Sect. 14.31 

We compare our resul ts to precise r ecent measurements of 
z = 4 LBG clustering by lOuchi et al.l (I2005I) . For these com- 
parisons our /?veea limits must be converted to the AB sys- 
tem (+0.2 mag) and the distance modulus between z — 3 and 
Z = 4 must be added (+0.8 mag for ACDM). Since the R-band 
at z = 3 closely resembles the /-band at z = 4 in terms of 
restframe wavelength coverage we do not apply a ^-correction. 
The agreement of both studies shown in Tableland Fig.fTOlis 
excellent with most corresponding measurements lying within 
the l-o" intervals. Considering the systematic differences intro- 
duced by different filter-sets, different depths, different selec- 
tion criteria, etc., the agreement is rather impressive. However, 
considering the cosmic time and the structure formation that 
took place between z = 4 and z — 3 this means that an LBG 
at z — 3 is hosted by a significantly more massive halo than an 
LB G of the same luminosity at z = 4 (see Sect. 14.3b . 

Adelberg er et al.l J2005) confine their samples of optically 
selected, star-forming galaxies to the magnitude range 23.5 < 
Rab ^ 25.5, which corresponds to 23.3 < i^vega ^ 25.3. In this 
magnitude range the correlation length deriv ed from our sur- 
vey is slightly larger than the value found by lAdelberger et al 



(2005) while the slopes found in both studies agree very well 



within the uncertainties (see Table|2]i. To compare the dep th of 
our images with the ones used in lAdelberger et al.l d2005l) we 
calculate l-cr AB limiting magnitudes in aperture s with an area 
that is three times as large as the seeing disk like in [ Steidel etaO 
(2003) where the imaging data used bv l Adelberger et alT 32005) 
are described. We find that our images are slightly shallower in 
all three bands used for the selection of LBGs and thus, our 
larger correlation length may be due to incompleteness at the 
faint end of the 23.3 < R < 25.3 magnitude interval with the 
lAdelberger et al.l (|2005) LBG sample probing slightly deeper 
into the luminosity function. The same problem certainly ap- 
plies for the 22.5 < R < 25.5 and 22.5 < R < 26 subsamples; 
this might be the reason for the non-evolution of the correlation 
length for limiting magnitudes Rn m > 25. 



4.3. Small-scale clustering 

With the unprecedented statistical accuracy of our survey it is 
for the first time possible to clearly detect an excess of the an- 
gular correlation function of faint f/-dropouts on small scales 
with respect to a power law fit. In Fig.QT]the deviation of the 
angular correlation function with respect t o the power law fit- 
ted at large to intermediate scales is shown. lOuchi et al.1 (2005) 
and lLee et al.l (120061) report such a small-scale excess for z — 4 
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Fig. 10. Dependence of the correlation length and the slope of 
the correlation function on /?-band limiting magnitude (upper 
and middle panels, respectively). The crosses and the solid lines 
represent our data. The triangles (slightl y offset for c l arity) a nd 



the dotted lines show the values from lOuchi et al.l d2005l) at 
z = 4 in comparison. We relate their i' AB limiting magnitudes 
to our /?vega limiting magnitudes as described in the text. The 
lower panel shows the contamination fraction for the different 
magnitude-limited subsamples with 22.5 < R < Ry lm with the 
solid line representing the total contamination and the dashed 
line representing the stellar contamination. 

LBG samples from the Subaru/XMM-Newton Deep Field and 
the GOODS fields, respectively. 

This excess on small scales is interpreted in both studies 
as being due to the contribution from a 1-halo term of galaxy 
pairs residing i n the same halos. We apply the halo model by 
to our data to have a direc t comparison 



Hamana 



iding in the s 
et all (12004 



with the z — 4 results from lOuchi et al.l (12005b who use the 
same model. 

In this model the angular correlation function of LBGs is 
calculated from the CDM angular correlation function by ap- 
plying the following halo-occupation-distribution (HOD) for 
single galaxies: 



JVo(M) 



{(MIMiT for M>M U 
1° 



for M <M„ 



(7) 



and the following HOD for pairs of galaxies: 



(N g (N g -l))(M) 

'n\ (M) if N g (M) > 1 

= - Nl (AO log [4JV g (M)J / log 4 if 1 > N g (M) > 0.25 , 



otherwise 



Fig. 11. Upper panel: Angular correlation function for U- 
dropouts with 22.5 < R < 26. The solid line represents a power 
law fit to the data in the range Of 1 < 6 < 10'. Lower panel: 
Ratios of the angular correlation function to the best-fit power 
law with a significant excess on small scales. 



with N s (M) being the number of galaxies in a halo of mass M, 
(N g (Ng - 1)^ (M) being the number of galaxy pairs in a halo 
of mass M, and M mm , Mi, and a being the parameters of the 
model. Furthermore, we calculat e the number density of LBGs 
from this model as described in lHamana et al. (2004). 

Applying a combined maximum likelihood fit to the angu- 
lar correlation functions and the number densities we find the 
best-fitting model parameters for the different magnitude lim- 
ited subsamples. From these best-fit parameters we calculate 
the average mass of an LBG hosting halo, (Mh a i ), and the av- 
erage number of galaxies inside this halo, which are also 
tabulated in Table [2] 

Given the good agreement between our corre lation func- 
tions at z = 3 and the corresponding ones from lOuchi et al 
4, and given the structure growth of the dark mat- 
3 and z = 4 it is not surprising that 



(8) 



(2005) atz 

ter density field between z 
we get slightly larger halo masses. This would imply that star 
formation, which is mostly responsible for the restframe UV 
flux, was slightly more efficient at higher redshift. However, 
the evolution in halo mass is rather small and not very signif- 
icant. Judging from the residual x 1 values for the best-fit pa- 
rameters this model is still too simple to account for the shape 
of the angular correlation functions and the number densities 
simultaneously. 

The mean number of LBGs per halo is well below one. 
This means that there are a lot of halos which are not occu- 
pied by LBGs down to the particular flux-limit. Nevertheless, 
this does not mean that these are dark matter halos that do not 
host a galaxy. Massive galaxies that are not actively forming 
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stars may be very faint in the restframe UV and have such 
red colours that they can easily escape our Lyman-break se- 
lection technique. Other techniques incorpor ating near-IR data 
must be used to select these po pulations (see Fran x et al . 2003; 
van Dokkum et all2003l IBaddi et alj|2004b . 



5. Conclusions 

We measure the clustering properties of a large sample of U- 
dropouts from the ESO Deep Public Survey with unprece- 
dented statistical accuracy at this redshift. 

Candidates are selected via the well-known Lyman-break 
technique and the selection efficiency is investigated and op- 
timised by means of simulated colour catalogues. The angu- 
lar correlation function of LBGs is estimated over an area of 
two square degrees, depending on depth, and a deprojection 
with the help of the photometric redshift distribution yields es- 
timates for the correlation lengths of different subsamples. 

We find clustering segregation with restframe UV- 
luminosity indicated by a decreasing correlation length and a 
decreasing slope of the correlation function with increasing 
limiting magnitude. The latter result was reported at redshift 
z = 4 and is now confirmed at redshift z — 3 for the first time. 
Furthermore, the unprecedented statistical accuracy of our sur- 
vey at z = 3 allows us to study the small-scale clustering signal 
in detail. We find an excess of the angular correlation func- 
tion on small angular scales similar to that found previously at 
Z = 4. 

Applying a halo model we find average masses for LBG- 
hosting halos at z = 3 which are slightly larger than literature 
values for z = 4 implying decreasing star-formation efficiency 
with decreasing redshift. 
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